arXiv:1508.01586vl [cs.CC] 7 Aug 2015 


LOWER BOUND FOR THE UNIQUE GAMES PROBLEM 


RAJEEV KOHLI AND RAMESH KRISHNAMURTI 


Abstract. We consider a randomized algorithm for the unique games 
problem, using independent multinomial probabilities to assign labels 
to the vertices of a graph. The expected value of the solution obtained 
by the algorithm is expressed as a function of the probabilities. Finding 
probabilities that maximize this expected value is shown to be equivalent 
to obtaining an optimal solution to the unique games problem. We attain 
an upper bound on the optimal solution value by solving a semidefinite 
programming relaxation of the problem in polynomial time. We use a 
different but related formulation to show that this upper bound is no 
greater than 7r/2 times the value of the optimal solution to the unique 
games problem. 

Key words: Unique games, combinatorial algorithms, analysis of algo¬ 
rithms, randomized algorithms, semidefinite programming. 


1. Introduction 

Khot’s [To] unique games conjecture is an important open question in 
the area of computational complexity. It says that for certain constraint 
satisfaction problems, called unique games, it is NP-hard to distinguish 
between instances that are almost satisfiable and almost completely unsat- 
isfiable. Khot and Vishnoi m discussed how the conjecture has led to 
connections between computational complexity, algorithms, analysis and 
geometry. Raghavendra m showed that, if the conjecture is true, every con¬ 
straint satisfaction problem has an associated sharp approximation threshold. 
For background to the problem and the related literature, see Trevisan m- 
Arora et al. [T| observed that the unique games conjecture is one of 
the few open questions that could go either way. It would not be true if a 
polynomial time procedure obtained a non-trivial lower bound on the optimal 
solution value for the unique games problem. Polynomial time algorithms 
obtaining such bounds have been developed for restricted families of the 
problem, including those whose constraint graphs have expansion properties, 
are random graphs, or are random geometric graphs ([2|, [3|, [12)1. For 
arbitrary problem instances, nontrivial lower bounds can be obtained in 
subexponential time by using randomized algorithms due to Arora et al. [I] 

Date: July 28, 2015. 

Address'. R. Kohli, Graduate School of Business, Columbia University, New York, NY 
(rk35@columbia.edu) and R. Krishnamurti, School of Computing Science, Simon Fraser 
University, Burnaby, British Columbia, Canada (ramesh@cs.sfu.ca). 

1 



2 


RAJEEV KOHLI AND RAMESH KRISHNAMURTI 


and Boaz et al [Ij. But the performance of polynomial time algorithms for 
the general problem deteriorates as the number of labels increases (e.g., |5l, 

We describe a polynomial time procedure that does not find a solution 
but obtains a non-trivial lower bound on the optimal solution value of the 
unique games problem. The bound is obtained in two steps. The first step 
develops a continuous formulation of the unique games problem, then solves 
its semidefinite programming relaxation in polynomial time to attain an 
upper bound on the optimal solution value. The second step uses a geometric 
representation of the continuous problem to show that its optimal solution 
value is no smaller than 2/tt times the value of this upper bound. The 
formulation used for the semidefinite programming relaxation generalizes 
Goemans and Williamson’s [7] representation of the maxcut problem, and 
is different from previous formulations for the unique games problem (e.g., 
m, 0 , 0 , 0 , m)- It is obtained as follows. 

Consider a randomized algorithm that assigns labels to vertices using 
independent multinomial probability distributions. The expected value of 
its solution is a function of the probabilities with which it assigns labels 
to vertices. We show that the problem of maximizing this expected value 
over the probabilities is equivalent to finding an optimal solution to the 
unique games problem. We use the probabilistic representation to obtain 
two different formulations of the problem. Both formulations associate a 
vector in a unit sphere with a label for a vertex. The first formulation 
uses the cosines of the angles between vectors, and the second the angles 
themselves, to characterize the probabilities associated with the randomized 
algorithm. An upper bound on the optimal solution value is obtained by 
solving a semidefinite programming relaxation of the first formulation in 
polynomial time. The second formulation is used to show that this upper 
bound is no greater than tt/2 times the optimal solution value of the unique 
games problem. 

Organization of the paper. Section 2 describes the unique games problem, 
formulates the problem of maximizing the expected value of the randomized 
algorithm, shows that it is an extension of the unique games problem over a 
probability space, and discusses its relation with Goemans and Williamson’s 
formulation for the maxcut problem. Section 3 describes a vector representa¬ 
tion of the problem and obtains the semidefinite programming relaxation. 
Section 4 develops the alternative geometric formulation, examines its re¬ 
lation with the semidefinite programming relaxation, and obtains a lower 
bound on the optimal solution value for the unique games problem. 

2. Unique games problem 

Let G{V,E) denote a graph with |U| = n vertices and \E\ = m edges. 
Each vertex can be assigned one of A: > 2 labels, denoted r = 1,.. ., A. Each 
edge (i,j) G E has weight Wij > 0. We say that edge (f, j) G E is matched 
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(equivalently, its vertices are matched) if vertex i is assigned label r and 
vertex j is assigned label crij{r), where r = 1, ... ,k and crij{r) ^ o'ij{t) if 
r ^ t. Thus, for each edge (i,j) G E, the elements of the ordered vector 
Ujj = (iTjj(l),..., aij{k)) are the integers 1,.. . ,k. The rth element (Tij{r) 
corresponds to the label for vertex j that matches label r for vertex i. The 
objective of the unique games problem is to find an assignment of labels to 
all vertices that maximizes the sum of the weights Wij across matched edges. 

2.1. Formulation. Consider a randomized algorithm that assigns label r 
to vertex i G F with a multinomial probability pir, where pn + • • • +pik = 1, 
for all i G V. The probabilities pir can differ across both the labels and 
the vertices for a problem instance. We consider the problem of finding 
the probability values that maximize the expected value of the solution 
obtained by the randomized algorithm. We show that solving this problem 
is equivalent to finding an optimal solution for the associated unique games 
problem. 

The randomized algorithm matches (the vertices i and j of) an edge 
(i,j) G E with the probability 

k 

Pij = '^PirPja.jir), for all (i,j) G E. 

r=l 

Thus, the solution it obtains has the expected value 

k 

E[z]= Y, WijPij= Y '^WijPirPjai^(ry 

(i,j)eE r=l 

We consider the following problem, denoted P, in which the decision variables 
are the probabilities pir and the objective function maximizes the value of 
E[z]. 


(P) Maximize E[z] = E E WijPirPjuijir) 

{i,j)eE r=l 


subject to Y^Pir ~ fo'^ f G F, 


r=l 


0 < Pir ^ 1 , for all r = 1,..., fc, z G V. 

Since P is a maximization problem, the constraint on the sum of the proba¬ 
bilities can be written as an inequality: Pii + ■ ■ ■ +Pik < 1, for all i G V. We 


will use this representation for proving Theorem 4.1 
Let 

Pir = 2 ^ Vir 
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Then ?/ir/2 is the deviation of pir from 1/2, and has a value between —1/2 
and 1/2. (Poljak et al. |13j used the same method to convert optimization 
problems with 0-1 decision variables into those with ±1 values.) Thus 


Pij 


\ ^(1 + Vir + Vjaijir) + yiryja,j(r)), for all {i,j) E E. 

r=l 


The constraint 


becomes 


k ^ \ 

r=l r=l 

k 

Uir = 2 — k, for all i €V. 

r=l 


Thus, the following problem, denoted PI, is equivalent to problem P. 


(PI) Maximize E[z] = - E E Wij{l -f Vir + yjaijir) + yiryjaijir)) 

{i,j)£Er=l 

k 

subject to Uir = 2 — k, for all i E P, 

r=l 

— 1 < yir <1, for all r = 1,..., fe, i E V. 

Let z denote the value of a feasible solution, and z* the value of the 
optimal solution, to a unique games problem. 

Theorem 2.1. Problem PI is a continuous extension of the unique games 
problem. Its optimal solution (1) is obtained when pir E { — 1,1}, and (2) has 
the same value z* as the optimal solution to the unique games problem. 

Proof. To show that the problem of maximizing E[z] is a continuous extension, 
it is sufficient to observe that (1) it is well-defined for all values of —1 < yir < 1 
(that is, 0 < Pir < 1), where r = 1,... ,k and i G V; and (2) any feasible 
solution to the unique games problem in which each vertex i E P is assigned 
label Tj is also obtained by the randomized algorithm when = 1 (that 
is, Pin = 1) and pir = —1 (that is, pir = 0) for each r / r*, r = 1,..., fe. 
It follows that max LI [z] > z*, because the optimal solution to the unique 
games problem is a feasible solution to the problem of maximizing E[z\. On 
the other hand, max£'[ 2 ;] < z*, because E[z\ is an expected value computed 
over the set of feasible solutions to the unique games problem, none of which 
can exceed the value z*. Thus, maxLl[ 2 ;] = z*. 

□ 

Restricting the probabilities pir to 0-1 values in problem P gives a discrete 
formulation of the unique games problem, edge {i,j) being matched with 
probability pij E {0,1} for all (f, j) E E. This is equivalent to restricting the 


LOWER BOUND FOR THE UNIQUE GAMES PROBLEM 


5 


yir variables to ±1 values in problem PI. We interpret the latter formulation 
and observe that Goemans and Williamson’s [7j formulation for the maxcut 
problem is its special case. 

First, note that the constraint yii + - ■ ■ + yik = 2 — A: in problem PI implies 
that 

1 ^ ^ 

Pij = 4 ( 4 -^ + 

r=l 

Since 0 < pij < 1, 

k 

k-A< '^Viryjaiji.r) < k. 
r=l 

Next, suppose yir G { — 1,1}, for all r = 1,...,/c and i G V. Then the 
constraint yn + ■ ■ ■ + yik = 2 — k is satisfied only if yir = 1 for the label that 
is assigned to vertex i, and yir = —1 for the other k — 1 labels. Suppose that 
edge {i,j) is matched, that vertex i is assigned label s, and that vertex j is 
assigned the matching label (7ij{s). In this case, 

yisyjaij{s) (1)(1) 

and 

yiryja,j(r) = (-1)(-1) = 1, for all r ^ s. 

Thus, 

k 

'^yiryjaijir) = 1 ( 1 ) + (^ “ 1 )( 1 ) = k, 

r=\ 

and 

1 ^ ^ 

Pij = + yirVja^Ar)) = 

r=l 

Now suppose that edge {i,j) is not matched, that vertex i is assigned label 
s, and that vertex j is assigned label o'ij{t), where s / t. In this case, 

yisyjcrij{s) (1)(~1) ~1) 


yuyja.jit) = (-i)(i) = -1, 

and 

yiryjaijir) = (-1)(-1) = 1, for all r ^ s,t. 

Thus, 

k 

'^yiryjaiiir) = (“ 1 ) + (“ 1 ) + {k - 2){l) = k - 4, 

r=l 

and 

1 ^ 

Pij = + = 0 - 

r=l 

We conclude that if yir G {—1,1}, then pij G {0,1}, and Yli j)^E'^ijPij 1® 
the value of a feasible solution for the unique games problem. 
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2.2. Maxcut problem. Consider problem PI for k = 2, yjai {i) = 2 and 
yja,,{ 2 ) = 1- Then 

Pij = 4 ^^ “ ^ + VilUjaijil) + yi2yja,j(2)) 

= |(2 + yiiyi2 + yi2yji)- 

Problem PI becomes 


Maximize E[z\ ^ E Wij{2 + yiiyj2 + yi2yji) 

(*j)6E 

subject to yn + yi 2 = 0, for all i G Pi, 

-1 < yii, 2/12 < 1, for all r = 1, 2, z G P. 

We eliminate the constraint yn + 1/12 = 0 by substituting yi2 = —yn and 
yj2 = —yji into the objective function to obtain the following representation: 


Maximize E[z] = - ^ Wij{l - ynyji) 

subject to — 1 < 2/11 < 1, for all z G P. 

This is the formulation described by Goemans and Williamson [7] for 
the maxcut problem. The only difference, which is inconsequential after 
Theorem 2.1 is that the present formulation maximizes the expected value 
of a randomized algorithm and allows each yn variable to obtain any value 
between —1 and 1. 


3. Vector representation and relaxation 

Let «S'(fc_|_i)„ denote a unit sphere in (k + l)n dimensions. Let Vir denote 
a unit vector in 5(fc+i)„, for each r = 0,..., fe and z G P. We associate the 
vector Vir with label r for vertex z, for each r = 1,... ,k and z G P. The 
vectors Vio are not associated with labels, but are used as follows to define 
the probabilities with which the randomized algorithm assigns labels to the 
vertices. 

Let 

yir = Vio ■ Vir, for all r = 1,..., /c, z G P. 

Then the probability that vertex z is assigned label r is given by 

Pir = ^{1 + Vi0- Vir), for all r = 1,..., fc, z G P. 

Equivalently, 

Vio ■ Vir = 2pir — 1, for all r = 1,..., A:, z G P. 

Thus, Vio ■ Vir = —1 when pir = 0, and Vio ■ Vir = I when pir = 1: the vectors 
Vio and Vir lie in opposite directions when pir = 0, and in the same direction 
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when pir = 1. The constraint pn + • • • + Pik = 1, which was represented in 
problem VI as yn + ■■■ + pik = 2 — k, becomes 

k 

Vio ■ Vir = 2 — k, for all i ^ V. 

r=l 

Let 

Viryjaijir) = Vir ' Vj„..l^r), for all r = 1, . . . , k, i,j ^ V. 

Since yiryja,j(r) = {“^Pir “ 1)(r) - 1), we have 

Vir • VjrT^j(r) = ^[pir “ 2 ) ” 2 )' 

Thus for any label r = 1,..., fc: 

(1) = 1 when (i) Pir = Pja,j{r) = 1 (that is, Pir = Pjaijir) = I)', 
or (ii) Pir = Pjaij(r) = 0 (that is, pir = Pjaijir) = “I)- The vectors 
Vir and Vjfj. . (r) lie in the same direction when (i) vertices i and j are 
assigned labels r and aij{r), respectively, or (ii) when both vertices 
are not assigned these labels. 

(2) Vir ■ Vja,.(r) = “1 when Pir = 1, Pja,,{r) = 0 (that is, Pir = 1, 

yj<rijV) = = h, Pjaij(r) = 1 (that is, Pir = -1, yja,j{r) = !)• 

The vectors Vir and Vj„^.(^r) he in opposite directions when one, but 
not both, of the vertices i and j are assigned labels r and crij{r), 
respectively. 

Since Vio ■ Vio = 1, we can express Problem PI in the form of problem P2 
below. 


(P2) Maximize E[z] 


\ E E Viij (UjO'UjoTUjO'Uir TUjO'PjCTij (r) T Vir'Vja■^j (r 
{i,j)eE r=l 


k 

subject to Vio ■ Vir < 2 — k, for all i G V, 

r=l 


Vir ■ Vj^,.(^r) = yiryja^iir): for all r = 1, . . . , /c, i G V, 

-1 < Vir < 1, Vir G S^k+I)n, for all r = 0,..., fc, i G V. 


Observe that we have relaxed the equality constraints on the sum of the 
probabilities in problem PI to inequality constraints on the sum of Vio ■ Vir 
values in problem P2. Since P2 is a maximization problem, these constraints 
are tight in the optimal solution. From Theorem 2.1 
problem P2 is obtained when all the vectors u 


the optimal solution to 


lie in a 1-dimensional space. 
Relaxing the constraint Vir ■ Vj„..(j.-^ = Piryjaijir) iri problem P2 gives the 
following vector program P3, which can be solved in polynomial time. 
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(P3) Maximize Zi = - ^ Wjj iViO-ViO+ViO-Vir+VjO-Vjan (r) +Vir ■Vjan (r)) 


{i,j)&E r=l 


subject to ViQ ■ Vir < 2 — k, for all i G V, 

r=l 

Vir G 5'(fc+i)n, for all r = 0,..., /c, i G V. 

Let zl denote the optimal solution value for problem P3. 

4. Geometric formulation and a lower bound 

To obtain the desired bound on the optimal solution value of the unique 
games problem, we obtain another formulation of problem P. This new 
formulation is closely related to the preceding semidefinite programming 
relaxation. By construction, the lower bound on the optimal solution value 
for this new formulation is no smaller than 2/7r times the value of the optimal 
solution to problem P3. The key difference between the formulation of 
problem P2 and the following formulation is that while the former represents 
the Uir variables by the cosines of angles between vectors, the latter represents 
them by the angles themselves. 

Again, consider a unit sphere and unit vectors Vir representing 

labels r = 1,... ,k, for each vertex i gV . As in the preceding formulation, 
ViQ denotes an additional unit vector for each i G V. Let 


Pir = ;^(1 + Vir) = 1 “ - arccos(i;io • Vir). 
2 TT 


Then 


yir = 2(^1 - ^ arccos(uio • - 1 . 

Using the relation arcsin(x) + arccos(x) = tt/2 gives 
2 

yir = — arcsin(ujo • Vir), for all r = 1,..., A:, i G V. 

TT 


Figure 1. Geometric representation of yir = ^0, where 
9 = arcsin(uio • Vir) 
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Figure 1 shows the relation between 9 = arcsin(uio • Vir) and yir = 2pir — 1. 

We observe that for any label r = 1,..., fc; 

(1) 9 = j2 when yir = 1: vectors Ujo and Vir lie in the same direction 
when vertex i is assigned label r with probability pir = 1. 

(2) 9 = —7r/2 when y^r = —1: vectors Vio and Vir lie in opposite directions 
when vertex i is assigned label r with probability pir = 0. 

The constraint that each vertex is assigned a label with probability one 
becomes 

k 2 

y — arcsin(ujo • Vir) = 2 — k, for all i ^ V. 

jL^ TT 
r=l 

The probability that vertex i is assigned label r but vertex j is not assigned 
label (Tij{r) is given by — Pjcr^j{r))- Similarly, the probability that vertex 
j is assigned label o'ij{r) but vertex i is not assigned label r is given by 
(1 — Pir)Pjuij(r)- Thus, the expression 

Pir,jcrij(r) Piri^ Pjaij(r)') T (1 Pir)Pjcrij{r)i ^ 1, . . . , fc, 

gives the probability that edge (i,j) is not matched because one, but not 
both, of vertices i and j are assigned label r and label o'ij{r), respectively. 

In this case, we say that edge {i,j) is not matched via label r. Let Pir,jcjij(r) 
be proportional to the angle between vectors Vir and Vj„.. (r), for each r = 

Pir,jaij(r) Pir(l Pjaij{r)') T (1 Pir)Pjaij{r) —arCCOs('Ujj- • . 

Multiplying both sides of the preceding expression by —2 gives 

2 

^PirPjaij{r) ~ ‘2‘Pir ~ ‘^Pjaij(r) ~ ~~ 8'rCCOs(Ujr • V. 

Adding 1 to both sides of this expression gives 

^PirPjaij(r)-‘^Pir-‘2pjai,{r) + '^ = (2Kr-l)(r)“ 1) = 2(l-^ arCCOs(Ui^-Uj„,^,(,,)))-1. 

Since pir = (1 + yir)l2, we substitute 2pir — 1 = yir to obtain 


yirVjuijir) =2(1- arCCOs(Uir • Vj„..(r))) “ 1 


= - arcsin(ui^ • njay (r)), for all r = 1,..., /c, i,j e V. 

Figure 2 shows the relation between 9 = aicsm{vir-Vjf^.^(^r)) and yirUjaijir) = 
{2pir — — 1). We observe that for any label r = 1,..., k: 

(1) 9 = 7r/2 when yir = yja,,(r) = 1 or yir = yja,j{r) = -1- That is, 
vectors Vir and VjfJ^■{r) he in the same direction when (i) vertices i 
and j are matched using label r, or (ii) vertex i is not assigned label 
r and vertex j is not assigned label aij (r). 

(2) 9 = —7r/2 when yiryj^i (r) = “1- That is, vectors Vir and Vj^.(^r) he 
in opposite directions when edge {i,j) is not matched via label r. 
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Figure 2. Geometric representation of yiryjcn ir) = 
where 0 = arcsin(i;ir • 



Thus, the probability that edge (i, j) £ E is matched has the value 

Pij = 7 arcsin(i;io-i'io) + - aicsm{vio-Vir) + - arcsin(i;,o-Uj .(,.)) + - arcsin(i;ir-u,-^ 

4 tvr IT TT J j j ^ j 

r=l 

where we have substituted 

2 

1 = - arcsin(uio • Vio) 

TT 

because Ujo • = 1- It follows that problem P2 is equivalent to the following 

problem, denoted P4. 


2 \ _^ ^ j' 

(P4) Maximize E[z\ = — - E E arcsin(ujo • Vio) + arcsin(uio • Vir) 

(i,j)&Er=l 

+ arcsin(ujo (r) ) +arcsm(vir-Vj^.. (r)) j 

2 ^ 

subject to — > arcsin(tTio * Vir) ^ 2 — k, for all i E V, 

TT 

T=\ 

Vir G S(k+i)ni for all r = 0,..., /c, f G V. 

Theorem 2.1 implies that the optimal solution to problem P4 is character¬ 
ized by the following two conditions: 

(1) arcsin(ujr- • Vj„.^(^r)) G {—7r/2,7r/2}, which is equivalent to yir G 
{—1,1}, for all r = 1,..., A: and i G F. 

(2) arcsin(ujo • Vir) = tt/2 and arcsin(ujo • vu) = —vr/2, for all t ^ r, 
t = 1,... ,k and f G F. This is equivalent to yir = 1 for the label 
assigned to vertex f G F, and yir = —1 for the remaining A: — 1 labels 
that are not assigned to vertex i £ V. 

Thus, the optimal solution to problem P4 is obtained when the vectors Vir 
lie in a one-dimensional space, for all r = 0,..., A: and i £ V. 
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Theorem 4.1. z* = ma.'x.E[z\ > 

Proof. Consider the following constraint in problem P3; 


k 

Vio ■ Vir <2 — k, for all i £ V. 

r=l 


We can obtain a relaxed version of the constraint by replacing each term on 
the left hand side by another term that cannot attain a larger value than 
Vio ■ Vir- We do so below. 

We substitute x = Vio- Vir in the relation arcsin(x)/x < 7r/2 and rearrange 
terms to obtain 

2 

- arcsmfuio ■ Vir) < Uio • Vir- 

TT 

This gives the following relaxation of the constraint in problem P3: 

2 ^ 

— y arcsin(ujo • Vir) <2 — k, for all i £ V. 

TT 

r=l 

Thus the following problem, denoted P5, is a relaxation of problem P3. 


(P5) Maximize Z 2 = I ^ Wjj {ViO-ViO+ViO-Vir+VjO-Vjan (r) +Vir ■Vjaii (r )) 

(ij)eE r=l 

2 ^ 

subject to — > arcsin(?;^o * Vir) ^ 2 — A:, for all i E 

TT ^ 
r=l 

Vir £ *S'(A:+l)n) for all r = 0,..., /c, i £ V. 

Let Z 2 denote the optimal solution value for problem P5. Then Z 2 > zf, 
where zf is the optimal solution value for problem P3. 

Consider problem P4. It has the same constraints as problem P5. Since 
arcsin(x)/x > 1, the value of the objective function in problem P4 is no 
smaller than (2/7r)z2- Thus, the optimal solution value of problem P4 has 
the lower bound 

maxPl[z] = z* > —Z 2 > —zl- 

TT TT 

□ 


Let z* = maxi?[z] = (1 — e)n denote the optimal solution value for a 
unique games problem. Since z\ > z*, Theorem 4.1 implies that we can 
establish the lower bound z* > -(1 —e)n by solving problem P2 in polynomial 
time. Thus, we can distinguish such a problem from another unique games 
problem with optimal solution value less than -(1 — e)n. 
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